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Abstract. In this paper we extend the series of our studies on the proper- 
ties of an interacting particle model for market microstructure. In our earlier 
work we denned a Markov process on the majority opinion of the agents, ob- 
tained the transition probabilities and analyzed the martingale properties of 
the ensuing wealth process. Here we relax the assumption on the choices of 
individual agents by allowing mixed strategies, offering opportunities for the 
agents to gain intermediate submartingale exposure for their individual wealth 
processes. We develop a novel two-dimensional spin system to model the crit- 
ical regions of the wealth process as a reflection of the agents' behaviors. We 
exhibit strategic conflicts between individual market participants and the mar- 
ket as a whole, and identify a new source of uncertainty arising from 'reinforced 
expectations'. 



1. Introduction 

A series of interacting particle models have been proposed over the past decade 
to describe the dynamics of agent-based market microstructure models 
Often, these models use techniques from non-equilibrium statistical mechanics to 
investigate the tradeoff between the safety of trend following and the necessity of 
anticipating the majority in order to generate profits IK1 1^1 [TOj . 

In our earlier work, we extended such a spin market model, originally intro- 
duced by Bornholdt et.al. [7|, and characterized analytically its invariant measure. 
Also, we investigated the aggregate market wealth dynamics \T2\. This work led 
to an appreciation of the asymmetry between different quasi-stable supply-demand 
imbalance levels. 

The current paper extends the earlier framework by allowing the agents, with a 
certain probability, to choose strategically their next action, rather than be subject 
to the Hamiltonian dynamics on the space of spin configurations. 

In our revised model we extend the state space of our Markov Chain to include 
a set of supply/demand imbalance levels which represent the market participant's 
expectations. The resulting hybrid dynamics represent a mixture of the original 
hamiltonian stochastic dynamics presented in and the strategic dynamics of 
these expectation sets. We use this setting to investigate the concept of strategic 
stability that we introduced in f2] and discover situations where the individual 
agent's strategies are in conflict with the overall market interest. This finding 
provides a setting in which to investigate the social benefits of market coordination. 

Furthermore, the extended stochastic process we introduce here possesses regimes 
of non-unique invariant measure. We interpret the resulting path dependence as an 
example of reinforced belief dynamics, whereby an arbitrary choice attains physical 
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importance purely because a sufficient number of agents share it. Such 'self fulfill- 
ing prophecies' are a hallmark of the strongly interacting nature of markets, and 
constitute a main ingredient of any behavioral market model. It is our hope that 
the current model can help bridge the conceptual gap between physically motivated 
spin market models and their behavioral counterparts. 

2. A TWO-DIMENSIONAL SPIN PROCESS 

In this study, we modify the spin market model presented in Specifically, 
we will allow each agent to act strategically (in a sense to be defined below) with 
a fixed exogenous probability q. Let X denote the set of spin configurations on a 
lattice on the d-dimensional torus 1 Y = (Z/L) d C T d , i.e. X C { — for an 
appropriately chosen L so that \Y\ = N. It is convenient to identify the elements 
of Y with unique labels from the set {1,2,..., N}. Formally, we accomplish this 
by choosing a homcomorphism ip : Y — ► {1,2,..., N}. 

The state space of our revised process is X = X x X where the second component 
of a typical state (Ci, C2) represents a subset G C Y, i.e. j e G <^=> C2 (j/) = 1- 
This can be seen as the assignment of a 'two-dimensional spin' to the lattice Y, i.e. 
X 3 C : Y > {-Ml 2 - 

The path of a typical element of X is given by r\ : Y x (0, 00) — ► { — 1, l} 2 and 
each site x £ Y is endowed with a (typically t\) neighborhood Af(x) C Y it inherits 
from the natural topology on the torus T d . As before, for each ieF, Af(x) is a uni- 
formly chosen random subset of Y , of cardinality 2d. To be more precise, for a set A 
and a positive integer k, let F(A, k) = { (<2i, a%, . . . , a^) E A k \a,i ^ aj — 1,2,..., 
Then, for any x E Y, let {Af(x, •)} be a family of iid uniform random variables tak- 
ing values in F (Y \ {x}, 2d). 

We construct a continuous time Markov process with transitions occurring at 
exponentially distributed epochs, T n , with rate 1. We proceed as before to construct 
a transition matrix for the spins, based on the following interaction potential: 

h(x,T n ) = Vi(v>T n ) — &Vi( x > r ») J V" 1 E'7i(tf. T ») 

y£j\f(x,n) y£Y 

where a > is the coupling constant between local and global interactions. As 
discussed in observe that, as a result of the neighborhood randomization pro- 
cedure we introduced, h(x,t) depends only on the first dimension of the spin at x, 
r]i(x,t), and N + (t) = J2 x eY [ r ?i( a; >*) V0], i- c - the total number of positive spins. 
Specifically, consider two independent families of iid hypergeometric random vari- 
ables, {Ui, U2, ■ ■ •} and {Vi, V2, ■ ■ ■}, with parameter vectors (N — 1, i — 1, 2d) and 
(N — 2d) respectively. Then, for t s [T n , T n+ \ ), define 

h+i(i,t) = 2(U n -d)-a S - 1 



h-i(i,t) 



2{V n -d)+a 



N 
2i 
N 



1 



We see that, conditional on {N + (T n _ 1 ) = i}n{r]i(x, T n _i) 
of h(x,T n ) is the same as that for h±\{i 1 T n ). 



^We use the notation T d to denote the object S 1 X . . . X S 1 . 
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The flips of the first spin dimension are governed by: 



Pab(q,P,i,t) 



ai 1 — a 
N + 2 



1 + exp[-2b/3h a (i,t)] 



where (a, b) 6 { — 1,1} 2 and (3 is the normalized inverse temperature. At time T n 
(i.e. the n th epoch) a random site J n is chosen uniformly from Y. The variables 
p a h are interpreted as the resulting flip probabilities for the first spin dimension of 

p ab = Pr (r/ 1 (J„,T„_ 1 ) = a & r h (J n ,T n ) =&|S„_i D {N + (T n ^) = <}) . 
If we let 

^ = rnVM-riiVn,^) = N+{Tn) _ x+p^j e { _ lj0j 1}) 

we have 

Pr (X„ = a |B n _i R {iV + (T n _x) = »}) = />-«,«(?, /3, i,r B ). 

As stated so far, the transition probabilities of X (and therefore A r+ ) could be 
random. In particular, for t G [T n _i,T„) , even though h a (i,t) is measurable with 
respect to 23„_i, ^(tp^ 1 ^), t) isn't generically 2 . In order to describe the transition 
probabilities for the second component of our stochastic process, we need to define 
the wealth process |12j : 



W(y,T n ) = 



W(y,T n -i) for J„ = ? y; 

W(y,T n _i) +77i(y,T n _i)AP(T n ) otherwise. 



where 0) = K{y), representing the initial capital available to agent y, and 

AP(T n ) = P{T n ) — P(T n -i) is the price change at the n th epoch. In what follows, 
we will allow a more general price impact function than in our earlier models, as 
follows: 

AP(T n ) = P{T n ^)f(X n ,N), 

where / is a function that maps transient supply/demand imbalances X n to price 
shocks. The only assumptions we make about this impact function / is that it is 
nondecreasing in the first argument and nonincreasing in the second argument, and 
that it maps the balanced market to the fundamental price, i.e. /(0, N) = 0. In 
what follows, we use 7 to denote the ratio of the price impact of an incremental seller 
to that of an incremental buyer, i.e. 7 = jn-^r < 0, suppressing its dependence 
on N for convenience. 

Let P^ h {i) be independent random variables, identically distributed with the iid 
family p a (,(l, /3, i, •). These represent the purely stochastic transitions of the first 
spin dimension investigated in Using them, we define 

^(i) = -P?a,a(i) + 7i^-«(i), 

which is a random variable so long as f3 < 00, inheriting the randomness of h±i(i, •). 
On the other hand, as discussed in in the frozen phase of this process, almost 



2 This is because, for t € [T„_i,T n ), the distribution of h a (i,t) is determined by N + (T n _i), 
while, for J3 < 00, the distribution of p a b (and therefore P a j, and E a ) depend also on whether an 
agent with Hamiltonian h a has spin +1 or — 1, which is a Bernoulli random variable 
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surely, 

(2.1) £ + {i) = lim E^ii) = (l - ^) Pr (h-i(i, •) > 0) + ^Pr (h +1 (i, •) < 0) , 

which is not random. 

The role that p played for the transitions of the first spin dimension will now be 
played by A for the second spin dimension. Specifically, for (a, b) £ { — 1,1} 2 and 

t G [T„_i,T„), let 



A,,,(r, , / ) = Pv ( a£^(x)) + a & ( 1 - ~Vl - ^ ) - n 



B n -i n {^(a;, r„-i) = a} 



Note that the event £+(i) = — 6 ^1 — (l — -^-), which occurs generically with 
probability zero, would be added to the computation of A QQ , i.e. the probability 
of not flipping the second spin dimension. The variables X a b are interpreted as 
the flip probabilities for the second spin dimension of at the n th epoch, i.e. for 
t G [T„_i,T„) and all x G Y, 

\ a b(q,0,X,t) = Pr (rj 2 (x,T n ) = b\B n -i n {rj 2 (x,T n -i) = a}) . 



3. Convergence Results 

Observe that, unlike the first spin dimension, the second one is updated syn- 
chronously for all sites. Furthermore, using 1)2. lfl we see that in the frozen phase, 
A Q 6 G {0, 1}, because £f±_ is no longer random. In particular, let 

B={xeY\si(<p(x))>(l-l)(l * {X) 

and 



qj\ N 



C={xe Y\El (<p(x)) < ( 1 - ^ ^ 



qj N 

Ai = B (~)C C , A 2 = B DC , A3 = B c (1C C and Aa = B c n c. 

Then: 

Theorem 3.1. There are four distinct behaviors for r/ 2 : 

x G tp^ 1 (Ai) =^ ^(M) = 1 for t > T x 

x G ip^ 1 (A4) ==> n 2 (x, t) = —1 for t>T\ 

x G (fi^ 1 (A 2 ) => T) 2 (x,t) = n 2 (x,T ) fort > T 

x G ip^ 1 (A3) => mi x ^) = -mi x ,Tn-i) fort G [T„,T„ + i) tmdn > 0. 



TTie f/iird case entails path dependence, while the fourth leads to oscillating behavior. 
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In the rest of this paper, we will focus on the frozen phase (/? — > oo). Let 
P a b(i) = lim^^oo Pf b (i). As we saw in [TT], 

P ++ (i) = P__(i) = if z £ [N ( i - |) , AT (I + £)] 

^ ++ «= E if ^[^(i-|),iv(i + |)] 

3 = (d + c)v(i + 2d-N) 

^-(0= ( E /-(m) if^[iV(|-i),iV(i + i)] 



j=0V(i+2d- AT) 



N 



N 

1-P-) 



X-—AP- 

N 



with 





i 


1 




a 


N ~ 


2 





and C% denoting the combinations n choose k. 
Let 

*■«,(*) = lim lim Pr (N+ (T„) = I) . 

The following theorem describes the invariant measure of N + in this new two- 
dimensional spin process, extending Proposition 1 from 

Theorem 3.2. When Ai U A3 = there is a unique invariant measure for N + 
given by: 

1 - qP^(j) - (1 - q)xMi) 



9® 
Z{N) 



1 7=0 1 - * P ++C? + !)-(!- (i + 1) 

AT 

E^w 



i/^ > and g(O) = 1 



i=l 



noo (£) = (l + Z{N))~g(£) if <£< N and otherwise 

On the other hand, when A3 = but A2 ^ 0, the invariant measure described 
above is not unique, because ^('jCo) on A2 depends on ^(^O). In this case, any 
measure of the form above, substituting Ai with A4 U {i]2(-,0) = —1} and Ai with 
A\ U {r/2(-,0) = +1}, will be invariant under the two-dimensional spin process. 
Thus there are 2'^ 2 different invariant measures, one for each assignment of ±1 
to the second spin dimension of the points in A2 ■ 

Finally, when A3 ^ 0, no invariant measure exists for the two-dimensional spin 
process, because 772 never settles for the points in A3 . 

Figure ^ shows how the invariant measure varies as we decrease q away from 
1. The case q = 1, which was treated in JT], always led to symmetric tri- modal 
distributions. Here we observe that even a modest amount of strategic interaction 
leads to pronounced skew in the invariant measure. 

The bottom two frames of figure [21 show how the existence and uniqueness of 
the invariant measure described in Theorem 13.21 above depend on the value of q 



TED THEODOSOPOULOS AND MING YUEN 




q=0.95 



q=0.90 



0.12r 



0.1 



0.08 



0.06 



0.04 



0.02 



ILL' 



0.2 r 



0.15 



0.1 



0.05 




50 100 150 



50 



100 



150 



q=0.85 



q=0.75 




q=0.50 



50 



100 



150 



Figure 1. Skewing of the invariant measure as a result of the 
inclusion of q ^ 1 (7 = -0.7, a = 4.1, N = 128 and d = 2). 



(we will return to the top frame of figure in section Specifically we see that 
there is typically a contiguous range of small enough values of q for which the 
invariant measure does not exist. Thus, when strategic interactions dominate the 
market, agents expectations of desirable levels of supply/demand imbalance never 
settle down, indefinitely forcing the agents to chase unattainable majority/minority 
levels. 

On the other hand, there are islands of non-uniqueness throughout the range of 
q values, brought on by intermittent occupation of Ai- Except for sufficiently low 
values of q, the non-uniqueness is driven by very few (often only one) imbalance 
level whose status as desirable (or not) is determined by the initial conditions. The 
resulting path dependence propagates throughout the invariant measure. 

For instance, as we can see in figure the case q — 0.7 leads to a non- unique 
invariant measure because there is one imbalance level (it turns out to be N + = 61) 
which is mapped by ry 2 in Ai- The two resulting invariant measures are shown in 
figure|3 As we see, the flip of a single r\2 value in the initial conditions leads to more 
than double the limiting probability for a substantial range of seller-dominated im- 
balance levels. In fact, all imbalance levels are impacted by at least a few percentage 
points relative change in the limiting distribution. This phenomenon can be inter- 
preted as a sort of fad dynamic, a positive feedback of reinforced expectations with 
a surprisingly global and persistent effect. 
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Figure 3. The two invariant measures for 7 = —0.7, a = 5, 
TV = 128, d = 2 and q = 0.7. The non-uniqueness is driven by 
m (<p- 1 (61,0))=±l. 
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a =4.1 a =5 a =6 a =100 
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Figure 4. Dependence of tToo {[i* — 2, i* + 2]) on a and 7, where 
i* = argmax ie[0! jv] ^(i). 



The invariant measure changes qualitatively as 7 decreases towards —1 and a 
increases. Specifically, more symmetric price impact (7 \ —1) leads to a steeper 
concentration of measure as q decreases away from 1. In particular, as we increase 
the strategic interaction of the agents, all but one of the modes decrease rapidly, 
effectively concentrating the limiting distribution around the global mode. This is 
shown in figure which depicts the concentration of limiting probability within 
two imbalance levels of the global mode. 

On the other hand, increasing the overall coupling constant (a /* 00) moves the 
modes closer together without attenuating their height, until they are eventually 
merged. The transition to unimodal limiting distribution occurs at the 'kink' in 
the right most column of graphs in figure 01 for the value of q which minimizes the 
concentration of measure phenomenon. This effect is shown in figure El 

Multimodal invariant measures imply the existence of distinct imbalance at- 
tractors. Invariant measures more concentrated around their global mode imply 
markets with narrower price fluctuations. Therefore, even modest increases in the 
amount of strategic interaction among the agents quickly decrease the spread and 
complexity of the resulting price fluctuations. Moreover, this effect becomes more 
pronounced for more symmetric impact functions and more loosely coupled (less 
frustrated) agents. 

There also exist situations in which the invariant measure exhibits exceptional 
sensitivity to the amount of strategic interaction among the agents. Figure shows 
an example of this phenomenon. This radical shift in the imbalance attractor, from 
an average value of 10.84 at q = 0.11 to an average value of 87.71 at q = 0.12! Such 
large scale rebalancing of the invariant measure is likely to lead to discontinuous 
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FIGURE 5. Disappearance of bimodality as q / 1 for large a (7 = 
-0.9, a = 100, N = 128, d = 2). The bottom frame is a blowup 
around the global mode of the invariant measure. 





Figure 6. Discontinuous transition of invariant measure for mod- 
est change in the proportion of strategic interaction q [a = 5, 7 = 
-0.9, N = 128, d= 2). 



jumps in the resulting price process, due solely to a slight decrease in the strategic 
component of the interaction potential. 
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4. The Wealth Process Revisited 

We are now interested in characterizing the martingale properties of W(y, •) as 
well as the aggregate wealth, W, defined as 

W(T k ) = W(T fc _i) + AP(T fc )5^»7i(y,r fc _i) 

= W{T k ^) + AP{T k ) [2N+{T k ^)-N + X k ] . 
Using lj2.1|) , after some algebra we arrive at 

(4.1) E [W(y, T fc ) - W(y, T k _ x ) \B k . x ] = 

= - m (y, T fc _i)/(1, N)P{T k ^) (1 - N- 1 ) (1 + 7- 1 ) £+ (JV+T fc _i) 

and 

(4.2) E [W(T fc ) - W(T k ^) \B k -i ] = -/(l, iV)P(7fc-i) (l + 7- 1 ) 

{ ^(T^) - JV + 1] P_+ + 7 [2JV+(T fc _!) -N-l]P + _}. 

Using the invariant measure from Theorem 13.21 we can define (AWfc)oo as the ex- 
pectation, under the invariant measure ■n 001 of the expected wealth increment at 
the k th transaction time: 

(AW*)*, = -/(l,7V)P(P fc -i)(l + 7" 1 )(l + ^(iV))- 1 

N 

(4.3) J2 iW-N + 1] P. + (£) + 7 [2£-N-l] P+_} (£). 
e=o 

We can now return to the top frame of figure [3 which depicts (AWk)oo- As we see, 
the highest value of expected market wealth increments is achieved for a level of q 
close to 0.6. Specifically, the maximum value, 3.9128, is achieved for q = 0.56 and 
the invariant measure is not unique, because 772(59) G Ai. On the other hand the 
second highest value, 3.9102, is achieved for q = 0.62 and the invariant measure 
is unique. In fact, with the exception of narrow islands restricted to q < 0.3, the 
market expects to make money under the conditions in figure |21 

We proceed to iterate this computation of the optimal level of strategic interac- 
tion q* and the resulting maximum attainable expected market wealth increment 
(AWk)ta as we vary a and 7 (figure 0). We can make the following observations 
regarding the sensitivity of the expected market wealth increments to changes in 
the impact function asymmetry (7) and the overall coupling constant (a): 

• For all values of 7, the optimal choice of Strategic interaction level q leads 
to non-negative expected wealth increments for the market at large. 

• When the impact function is symmetric (7 = —1), the market can no 
longer make positive returns. Thus it is the impact function asymmetry 
that sustains positive expectations of broad market returns. 

• Modest positive impact asymmetry (incremental buy has slightly more ef- 
fect than incremental sell) leads to the minimum desirable amount of strate- 
gic interaction. 

• As the global coupling constant is increased, more strategic interaction is 
desirable while the attainable returns decrease. 

• When the coupling constant is increased beyond a sufficiently high value 
(around 5.9 for the example shown in figure EJ, all agents act exclusively 
strategically. 
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FIGURE 7. Sensitivity of q* and resulting (AWk)Zo to changes in 
a (left) and 7 (right) (a = 5 for the left panel, 7 = —0.9 for the 
right panel, TV = 128 and d = 2 throughout). 

Consider now the majority opinion of the agents, 

M(T k ) = 5>gn(E [W(y,T k ) -W(y,T k ^)\B k ^}) . 

Combining (|4.1() and 14.2(1 we arrive at the following observation: 

Theorem 4.1. When the market experiences a supermartingale, so does the ma- 
jority of the agents. There exist situations when the market disagrees with the 
majority of the agents, in the sense that their respective expected wealth increments 
have opposite signs. When the market disagrees with the majority, the market is 
experiencing a submartingale. 

Thus, there are cases when coordination of the agents to achieve a 'common 
objective' is desirable over individual optimization of their respective strategic in- 
teraction strengths. 

5. Conclusions and Next Steps 

In this paper we presented a two-dimensional spin market model. The first spin 
dimension represents the agents' decision to buy or sell, as in earlier models. The 
second spin dimension encodes a subset of supply/demand imbalance levels which 
are deemed to be desirable, because they lead the agent under consideration to 
experience a submartingale wealth process. 

We extended the analysis from 1 1 1 1 to describe the invariant measure of this novel 
process. Our principal findings are that, under certain conditions the resulting 
invariant measure is not unique, depending sensitively on initial conditions. We 
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interpret this behavior as a type of 'fad dynamic'. Also, there exist conditions 
under which the market disagrees with the majority of the agents in its assessment 
of the desirability of certain imbalance levels. Thus, coordination across the agents 
adds value beyond that attainable by individual optimization by the agents. 

It is natural to extend further our model by allowing each agent to adjust their 
degree of strategic interaction (q) dynamically as they experience the process. The 
resulting evolutionary game could provide insight into periodic imbalance attrac- 
tors. On the other hand, the thermodynamic limit (N — > oo) of this process is 
likely to provide estimates of the occupation density around individual imbalance 
levels. 
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